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WHAT IS CLAIMED IS: 

1 . A computer readable medium including instructions readable by 
5 a computer which, when implemented, cause the computer to handle 
information by performing steps comprising: 

receiving data over a network indicative of input at a client 
device and an indication of a grammar to be used with 
the data indicative of the input to perform recognition; 
10 and 

C3 sending data indicative of recognition results for the data 

indicative of the input to a remote location on the 
!f~ network. 

iS 2 . The computer readable medium of claim 1 wherein the indication 
" provides a reference to a location of the grammar. 

v! 3 . The computer readable medium of claim 1 wherein the 
D indication includes a reference to a language for recognition. 

fo 

4 . The computer readable medium of claim 1 wherein the markup 
language comprises one of HTML, XHTML, cHTML, XML and WML. 

5 . The computer readable medium of claim 1 wherein the markup 
25 language comprises a scripting language. 

6 . The computer readable medium of claim 1 wherein the markup 
language comprises synchronized multimedia markup language. 

30 7. The computer readable medium of claim 1 wherein the recognizer 
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comprises a speech recognizer and the grammar relates to speech 
recognition. 

8. The computer readable medium of claim 1 wherein the recognizer 
5 comprises a handwriting recognizer and the grammar relates to 

handwriting recognition. 

9. The computer readable medium of claim 1 wherein the recognizer 
comprises a gesture recognizer and the grammar relates to gesture 

10 recognition. 

^ 10. The computer readable medium of claim 1 wherein the recognizer 
Q comprises a visual recognizer and the grammar relates to vision 
recognition. 

p 11. A method for speech recognition in a client/server network, 
~1 the method comprising: 

O receiving data over a network indicative of input speech and 

an indication of a grammar to be used with the data 

2 0 indicative of input to perform recognition; 

processing the data using the grammar with a recognizer to 

obtain recognition results; and 
sending the recognition results for the data indicative of 

the input to a remote location on the network. 

25 

12. The method of claim 11 wherein the indication provides a 
reference to a location of the grammar. 

13. The method of claim 11 wherein the indication includes a 

3 0 reference to a language for recognition. 



89 



14. The method of claim 11 and further comprising providing a 
prompt to the remote location. 

15. The method of claim 14 wherein providing a prompt comprises 
converting text data to speech data and providing the speech data 
to the remote location. 

16. A computer readable medium having a markup language for 
execution on a client device in a client/server system, the markup 
language comprising instructions to unify at least one of 
recognition-related events, GUI events and telephony events on 
non-display, voice input based client device and a multimodal 
based client for a web server interacting with each of the client 
devices . 

17. The computer readable medium of claim 16 wherein the markup 
language comprises one of HTML, XHTML, cHTML , XML and WML. 

18. The computer readable medium of claim 16 wherein the markup 
language comprises a scripting language. 

19. The computer readable medium of claim 16 wherein the markup 
language comprises synchronized multimedia markup language. 



